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Abstract 

This study seeks to obtain argumentation models, which represent argumentative processes and an assessment 
structure in secondary school debatable issues in the social sciences. The argumentation model was developed 
based on mixed methods, a combination of both theory-driven and data-driven methods. The coding system 
provided a combing point by which the theoretical framework and data integrated into the model. Bayesian 
networks were used to assess and update student progress. The study examined how to explore argumentation 
knowledge structure and argumentative skills as a whole via data analysis and theoretical considerations. 
Effective argumentative representation is a crucial step to bridge argumentative learning and assessment. 

Keywords: argumentative representation, argumentation skills, Bayesian network model, evidence variable, 
explanatory variable, cognitive task analysis 

1. Introduction 

Argumentation as a cognitive theme has caused recent attention in education (Kuhn & Udell, 2003, Lu & Zhang, 
2013a). Researchers and educators have applied the elements of argumentation to cognition and learning in 
adolescents and young adults (Brem & Rips, 2000; Lu & Zhang, 2013b). These students should develop such 
knowledge and skills formally. However, serious weaknesses have been observed in argumentative learning in 
such age groups (Kuhn, 1991, 2001). 

From a cognitivist perspective, argumentation includes argumentative structure and cognitive skills (Alishahi & 
Stevenson, 2008). Argumentative structures can be seen in the formats of argumentative representations (Dung, 
1995) and models (Erduran, Simon, & Osborne, 2004). Argumentative cognitive skills consist of thinking, 
reasoning and discourse skills (Kuhn & Udell, 2003; Lu & Zhang, 2012; Shaw & Felton, 1997). 

This study examined argumentation learning of secondary school debatable issues in social sciences. We found 
that effective representation was critical to form and facilitate argumentative knowledge structure and cognitive 
skills. Based on such a representation structure, we established an argumentative learning model to describe 
students’ progress and to examine their cognitive errors. The researchers used Bayesian network model to 
differentiate students’ competences in argumentative processes and to describe distributions of different 
argumentative cognitive skills. This Bayesian model is a dynamic, multi-functional assessment tool to show 
student progress. 

2. Literature Review and Theoretical Framework 

2.1 Argumentative Structures and Models 

Different models describe argumentative structures. Toulmin’s (2003) argumentative model provides a 
theoretical framework for analyzing argumentative structure. This model asserts that most arguments consist of 
five elements: claims, grounds, warrant, backings, and rebuttals. In fact, the core parts of the model consist of 
grounds, claims, and warrant. The grounds provide evidence for the claims. A warrant links the data to a claim, 
legitimizing the claim by showing that data to be relevant; backings and rebuttals are two extra supports from 
positive and negative aspects. 

Toulmin’s argumentative model attempts to provide a general tool for all fields. Eemeren (1996) stated that 
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Toulmin’s model aims at creating a stronger epistemological and empirical logic that takes into account all sorts 
of topics in both everyday life and academic research. Eemeren questioned: “Is there one universal system of 
norms, by which all sorts of arguments in all sorts of fields must be judged, or must each sort of argument be 
judged according to its own norms (p. 1)?” In argumentative applications to the sciences and social sciences in 
recent decades, limitations distinguish categories of grounds (data), warrants and backings and further leave the 
ambiguity of argument structures (Erduran, Simon, & Osborne, 2004; Kelly, Druker, & Chen, 1998). With the 
advancement of cognitive theories and educational technologies, there are increasing demands for alternative 
argumentative models. However, the basic ideas and the components of Toulmin’s argumentative model are still 
applicable in the scientific fields and academic research. 

2.2 Argumentative Skills and Discourse 

Argumentative skills are developed from critical thinking skills. Kuhn and Udell (2003) suggest that 
argumentative skills are mainly expressed in reasoning skills and also include discourse skills. Educators would 
likely evaluate the quality of argumentations to determine student proficiency in advancing, critiquing, and 
defending claims in reasoned discussion. These argumentative skills are developed in collaboration with others. 
Also, discourse skills as a separate dimension contribute to argumentative development in claims with a great 
deal of data evidence during peer conversation (Kuhn, 2005). 

Argumentative skills enable students to deal with debatable issues with appropriate claims, coherent reasoning, 
sound evidence, and well-elaborated concepts (Kuhn, 1991). Studies indicate that argumentative skills have not 
been sufficiently developed in secondary schools (Kuhn, 1991) and that students have difficulty grasping the gist 
of argumentative structure and skills from argumentative discourse (Reznitskaya et al., 2001; Stein & Bernas, 
1999). 

3. Argumentative Tasks and Learning Trajectories 

Argumentative knowledge and skills can be acquired and developed when learners accomplish a set of cognitive 
tasks following a set of rules. Thus, cognitive task analysis and argumentative representation become crucial to 
exam students’ argumentative proficiency in advancing, critiquing, and defending claims (Kuhn & Udell, 2003). 

From the perspective of cognitive tasks analysis, argumentation is a process to go about a set of cognitive tasks, 
which contain argumentative goals. Most cognitive tasks are ill-structured and selected from authentic scientific and 
social issues. In other words, the cognitive tasks are not developed from a strict cognitive task design. Instead, a 
learner’s trajectory can be acquired by argumentative representations based on the cognitive task analysis (Lajoie, 
2003; Zhang & Lu, 2014). Effective argumentative representations are crucial to describe argumentative 
knowledge structures and skills towards proficiency advancing, critiquing, and defending claims in an arguing 
process. Thus, researchers can use cognitive task analysis techniques to develop variables from cognitive tasks 
and Bayesian networks can strengthen argumentative representation. 

4. Research Questions 

The purposes of the study were to explore an alternative method in students’ learning assessment based on their 
interactions focusing on a social issue theme. Bayesian network processes represented students’ learning 
trajectories and performance results on both evidence variables and explanatory variables. The following 
research questions were addressed: 

1) How is the argumentative representation model used to represent students’ learning processes in debatable 
social issues? 

2) How is the Bayesian network used to provide dynamic assessment information? 

3) How are the students’ conceptual understanding and perspectives of social debatable issues assessed 
diagnostically? 

5. Research Methods 

This study investigated debatable issues in social sciences, “a concerned group for women immigrating to an 
urban area,” as cognitive tasks to examine students’ formation of argumentative knowledge representation and 
development of argumentative skills. 

The following issue is an example: 

We are the “concerned group for women immigrating to an urban area”, and we are not accepted appointments on 
birth delivery services from “non-local pregnant women.” As a result of this arrangement, we were shut out from 
the services of public hospitals; and this deprived our right to give birth to their children... Based on the issue 
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description, students were asked to present their opinions and suggestions to solve this problem. 

5 .1 Participants 

Fifty-two eighth grade students participated in this study (ages 13 to 14). The school was chosen as it 
participated in a university-school partnership project involving the use of an online platform to teach liberal arts 
studies. The students were in two classes; 30 girls and 22 boys participated. The curriculum of the liberal arts 
studies consisted of modules that focus on specific issues in three major areas: (a) personal and self-development, 
(b) society and culture, and (c) science, technology and environment. Students studied a variety of topics such as 
interpersonal relationships, the city today, and public health. 

5.2 Cognitive Tasks about Social Debatable Issues 

The cognitive tasks consist of three independent paragraphs regarding information about “women immigrating to 
an urban area.” Basically, the women in the scenario were from Mainland China and they wanted to deliver their 
babies in Hong Kong and they did not want to pay for the delivery. In this scenario local women (from Hong 
Kong) could deliver their babies in hospitals without delivery costs because they were considered local. The 
issue involved several social issues, such as politics, poverty, and discrimination. The cognitive task structure in 
this scenario consisted of two parts: issue description and essay questions. 

The first item of information was about the equality of charging delivery fees to pregnant women who 
immigrated to the special urban area in Hong Kong. The concerned groups request the government to treat them 
equally. For instance, the pregnant members of the concerned group request the government to allow them to 
deliver their babies in a local hospital without charging delivery fees. 

The second item of information is about an individual case that describes a woman of the concerned group who 
was charged the delivery fee. Three judges of the Court of Appeal then unanimously ruled that it was legitimate for 
the Hospital Authority (HA) to charge delivery fees to non-local pregnant women. 

The third item of information reflects a voice from a local pregnant woman. She said that the delivery room was 
overbooked because the concerned group of women who immigrated to the special urban area. 

Following these paragraphs of information, three questions have been posed to the students: 

a. By combining information 1, 2, and 3, and your background knowledge, try to identify the different 
stakeholders and their perspectives/comments they would have regarding the women from Mainland China 
immigrating to the special urban area.” 

b. Do you agree with the views of the pregnant woman in information 2? 

c. How does the case mentioned in information 2 reflect the spirit of the “rule of law” in the special urban area? 

5.3 Argumentative Task Analysis 

An argumentative tasks analysis is a cognitive task analysis (CTA) in argumentation. Clark and Estes (1996) 
suggest that methods can be considered from two dimensions: knowledge elicitation and data analysis. In this 
study, we took a CTA-grounded theory pair. From the knowledge elicitation dimension, we identified aspects of 
representation based on the content knowledge, argumentative knowledge, and skills. From the data analysis 
dimension we used grounded theory to focus on basic argumentative components. We used three steps in the 
coding process: open coding, selective coding and theoretical coding (Clark, Feldon, van Merrienboer, Yates, & 
Early, 2008; Clark, Feldon, & Yates, 2011; Zhang & Lu, 2014). Based on the analysis a coding system has been 
developed (see Appendix 3). 

5.4 Argumentative Representations 

Argumentative models can be represented in Bayesian networks (Koski & Noble, 2009; Lynch, 2010). The 
argumentative model is presented in Figure 1. There are two kinds of variables in the model: evidence variables 
and explanatory variables. The evidence variable can be used to collect evidence directly from the student 
completion of current debatable issues; the explanatory variable is a latent variable that is unobservable. In total, 
there are four explanatory variables and 11 evidence variables in this study. The evidence variables include: 
conceptual clarification, identifying stakeholders (in all perspectives), multiple perspectives, stakeholder 
(identified in single perspective), state of standard point, confirmation of standard point, matching, apply 
information from case, apply outside information, explanation, and conclusion. The explanatory variables are 
argumentative representation, perspectives, standard point, and position and claim. 
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Figure 1. A representation model of argumentation learning of the debatable issues 


6. Data and Evidence 

6.1 Simulated Evidence 

A random sampling method was applied to test evidence states, from one true evidence to 10 true evidence 
observations in the simulation. The true status meant the variable acquired a positive value based on each student’s 
completion of one piece of argumentation knowledge or skill. In order to reduce the tedious process of the test, the 
random process started from a zero mastery model, which meant that the 11 evidence variables did not present any 
positive values. The student had zero evidence of these variables. At the next step, the simulated data of the evidence 
variables demonstrated there are one, two, and three evidence until a complete model, which meant the student had all 
11-evidence variables. That meant the student scored 78.55% in argumentative representation in the argumentative 
Bayesian model. The argumentative progress status is listed in Table 1. 


Table 1. Random evidence probabilities of four explanatory variables 


Number of Positive Evidence 

Perspectives 

Standard Point 

Position and Claim 

Argumentative Representation 

0 

0.1654 

0.1161 

0.2016 

0.2231 

1 

0.1645 

0.1192 

0.2876 

0.2312 

2 

0.1668 

0.1218 

0.3591 

0.2611 

3 

0.2291 

0.2987 

0.3782 

0.3255 

4 

0.4637 

0.3191 

0.4175 

0.4334 

5 

0.4877 

0.4439 

0.5279 

0.4628 

6 

0.2312 

0.8722 

0.5413 

0.5576 

7 

0.6347 

0.8995 

0.5559 

0.7062 

8 

0.8011 

0.7211 

0.6813 

0.7011 

9 

0.8355 

0.9022 

0.7302 

0.7689 

10 

0.8356 

0.9087 

0.7822 

0.7816 

11 

0.8389 

0.9092 

0.7891 

0.7855 


6.2 Student Evidence 

For illustration purposes, we only choose six students from the 52 students to discuss here. Students’ 
argumentation scores on the debatable social issue can be seen in Table 2. The full argumentation scores from 52 
students can be seen in Appendix 1. Table 2 shows that scores are the records of students’ argumentative 
completion across 11 evidence variables. For example, student one scored the highest score on Multiple 
Perspectives (with 4 points) and the lowest score on Identifying Stakeholders (with 0 point). Each student has a 
unique combination of all 11 evidence variable values, which consists of a vector. For example, for student one 
the vector is V s i= (1, 0, 4, 3, 2, 1, 2, 2, 0, 0, 0). All of these evidence variables are used to provide evidence for 
updating these explanatory variables. 
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Table 2. Students’ scores from eleven evidence variables 


Student 

ID 

Concept 

Clarification 

Identifying 

Stakeholders 

Multiple 

Perspectives 

Stakeholder 

Identified 

State of Stand 
point 

1 

1 

0 

4 

3 

2 

2 

1 

1 

3 

3 

2 

3 

1 

0 

3 

2 

2 

4 

1 

1 

3 

3 

1 

5 

1 

0 

3 

2 

2 

6 

1 

0 

3 

2 

2 


Table 2. Students’ scores from eleven evidence variables (continued) 


StudentID Confirmation of Standpoint Matchmg Applymg mf ° fl '° m Applying outside Ex p lanation Conclusion 

case into 


1 

1 

2 

2 

0 

0 

0 

2 

1 

2 

2 

0 

1 

0 

3 

2 

2 

3 

0 

0 

1 

4 

2 

2 

2 

0 

1 

1 

5 

1 

2 

2 

0 

1 

0 

6 

2 

2 

2 

0 

0 

0 


7. Results 

7 .1 Students ’Argumentation Scores in Explanatory Variables 

Students’ argumentation scores on 11 evidence variables indicated their proficiency in the argumentative process. 
A student’s argumentation proficiency was represented by four explanatory variables: argumentative 
representation, perspectives, standard point, and position and claim. The argumentative representation measured 
a general argumentative proficiency. The completing levels of other three explanatory variables were directly 
related to the general argumentation representation. 

As soon as we entered values of evidence variables based on the data in Table 2 into the Bayesian network, it 
was updated (see Figure 2). When we examined the output of the Bayesian network model (Jouffe & Conrady, 
2011), we can see the updated probabilistic value of each evidence variable. The output can be seen in Figure 3, 
which reports the result of student one’s performance. When the student one’s evidence variable vector, V s i= (1, 
0, 4, 3, 2, 1, 2, 2, 0, 0, 0), was entered into the Bayesian network we received the updated value of each 
explanatory variable. For student one, the Perspectives was 52.44%, Stand Point was 50.61%, Position and 
Claim was 53.45% and Argumentative Representation was 51.79%. We can examine the student’s performance 
at both general level at Argumentation Representation and sub-level at such as Perspective, Stand Point, and 
Position and Claim. 
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Figure 2. An updated argumentative representation model of the debatable issues 


Argumentative Representation 


Perspectives 


51.79% True 

48.21% ^ _ False 


52.44% True 

47.56% p ! _ False 


Stand Point 


Position and Claim 


50.61% True 

49.39% _False 


53.45% True 

46.55% _False 


Figure 3. The outputs of updated probabilities of the explanatory variable with student one evidence 


From Table 3 we see there are different argumentative proficiency levels. We examined Table 3 in two 
dimensions. One dimension is the row dimension, which reflects students’ scores across all argumentative 
explanatory variables. From student 3, for example, the explanatory variable values report the learner’s different 
levels of the argumentation proficiencies. Although the Argumentative Representation is 0.8227, the perspective 
indicates 0.2718, which is very low. This provides a diagnostic assessment information for each student’s 
progress in argumentation learning. 

The column dimension reflects a distribution of explanatory variables. For example, when we examine the 
perspectives column, we can see that student 16 receives the lowest score in Perspective at 0.0620, and student 
33 receives highest score at 0.9274. The lowest Stand Point score was from student 38 at 0.2055 and the highest 
Stand Point score was from student 36 at 0.8562. The lowest Position and Claim score was from student 39 at 
0.0165 and the highest was from student 4 at 0.9691. Last, the lowest Argumentative Representation score was 
from student 50 at 0.0939 and the highest one was from student 36 at 0.9705. 


Table 3. The summary of explanatory variables of the students’ argumentation 


Student ID 

Perspectives 

Stand Point 

Position and Claim 

Argumentative Representation 

01 

0.5244 

0.5061 

0.5345 

0.5179 

02 

0.6599 

0.5510 

0.8324 

0.6501 

03 

0.2518 

0.8310 

0.9491 

0.8227 

04 

0.7448 

0.7325 

0.9691 

0.9145 

05 

0.7964 

0.5005 

0.8017 

0.5016 

06 

0.2220 

0.7580 

0.8198 

0.5891 

07 

0.2227 

0.3422 

0.7956 

0.4722 

08 

0.2727 

0.3422 

0.7956 

0.4722 

09 

0.2533 

0.5650 

0.3221 

0.3997 

10 

0.7404 

0.8231 

0.6442 

0.8419 

11 

0.2036 

0.5005 

0.8017 

0.5016 
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12 

0.1441 

0.7520 

0.8150 

0.5661 

13 

0.2660 

0.8117 

0.6992 

0.7977 

14 

0.9024 

0.6810 

0.8544 

0.7562 

15 

0.7270 

0.4606 

0.8757 

0.8591 

16 

0.0681 

0.7209 

0.5099 

0.4453 

17 

0.3523 

0.8044 

0.6197 

0.7694 

18 

0.7137 

0.8020 

0.9376 

0.7599 

19 

0.5076 

0.7223 

0.9669 

0.8832 

20 

0.7270 

0.4606 

0.8557 

0.8591 

21 

0.1778 

0.3986 

0.4875 

0.3794 

22 

0.1441 

0.7520 

0.8150 

0.5661 

23 

0.2009 

0.7322 

0.5246 

0.4889 

24 

0.2114 

0.6103 

0.8094 

0.5389 

25 

0.1926 

0.4829 

0.6424 

0.4497 

26 

0.6112 

0.4622 

0.6788 

0.5699 


Table 3. The summary of explanatory variables of the students’ argumentation (continued) 


Student ID 

Perspectives 

Stand Point 

Position and Claim 

Argumentative Representation 

27 

0.2070 

0.6098 

0.8091 

0.5375 

28 

0.7215 

0.8397 

0.8435 

0.9061 

29 

0.5733 

0.4236 

0.3389 

0.4544 

30 

0.1967 

0.2155 

0.2851 

0.4879 

31 

0.6941 

0.5246 

0.5316 

0.7564 

32 

0.2473 

0.6656 

0.5992 

0.7091 

33 

0.9274 

0.8439 

0.8888 

0.9224 

34 

0.7000 

0.6870 

0.4373 

0.7748 

35 

0.2229 

0.5317 

0.3139 

0.5933 

36 

0.7426 

0.8562 

0.8988 

0.9705 

37 

0.7511 

0.7389 

0.4862 

0.9341 

38 

0.1912 

0.2055 

0.9360 

0.4430 

39 

0.0624 

0.3647 

0.1050 

0.1019 

40 

0.2210 

0.6251 

0.9460 

0.5845 

41 

0.1027 

0.4726 

0.6333 

0.4195 

42 

0.5850 

0.7856 

0.8420 

0.6964 

43 

0.6842 

0.7932 

0.8481 

0.7258 

44 

0.7230 

0.8243 

0.6458 

0.8466 

45 

0.0681 

0.7209 

0.5099 

0.4453 

46 

0.2220 

0.7580 

0.8198 

0.5891 

47 

0.1441 

0.7520 

0.8150 

0.5661 

48 

0.2249 

0.6819 

0.5953 

0.2937 

49 

0.1496 

0.4136 

0.0165 

0.2458 

50 

0.0620 

0.3638 

0.0910 

0.0930 
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51 

0.1441 

0.7520 

0.8150 

0.5661 

52 

0.1211 

0.3677 

0.9300 

0.1108 


7.2 Students ’Argumentative Representation and Assessment 

We examined students’ argumentative representation and relevant perspectives based on their scores in Table 3. 
We developed classification rules in terms of norm-based assessment. In other words, we assessed students’ 
argumentative scores based on the 52 students’ performance. We linearly divided students’ score based on the 
range of each explanatory variable into 3 equal distance (Zhang & Lu, 2014). Thus, we received three score 
levels of each explanatory variable and we coded them from lowest, medium to highest three levels. That means: 

1 = lower level, 2 = medium level, and 3 = higher level. For example, we use Perspectives to illustrate this 
process. The range of these variables is 0.8654. We can get the equivalent distance 0.2885 (cut-off), which is 
from 0.8654 divided by 3. Based on this cut-off we classified all students into three levels for Perspective. The 
similar computing is applied to other three explanatory variables and we received three levels of these four 
explanatory variables. The results can be seen in Appendix 2. 

In order to provide diagnostic assessment information we summarize Appendix 2 into Table 3. Based on students’ 
performance on four explanatory variables: Perspectives, Stand Point, Position and Claim, and Argumentative 
Representation we present the youths’ scores in a vector consisting of 4 elements. Thus, we see that there are 22 
different patterns used to describe the students’ scores. For example, for group one student: #39 and #49, V a i = (1, 
1, 1, 1). This means that students scored at the lowest level in four explanatory variables. We can also look at 
group 12 for the pattern vector V s i 2 = (1, 3, 3, 2). There are five students in this group. They are #6, #12, #22, #46, 
and #47. It means that these students scored at the lowest level on Perspectives, at the high level on Stand Point and 
Position & Claim and at a medium level on Argumentative Representation. This is very interesting because although 
two sub-level explanatory variables scored very high, it does not guarantee the student can receive highest score on 
the general explanatory variable. Last, we selectively chose group 22 in which V a22 = (3, 3, 3, 3). There were six 
students in this group: #4, #18, #28, #33, #36, and #43. They scored at highest level on these four explanatory 
variables. 


Table 4. Group distributions of subject members in four argumentative categories 


Group 

Perspectives 

Stand Point 

Position & Claim 

Argumentative 

Representation 

Subject Number 

1 

1 

1 

1 

1 

#39, #49 

2 

1 

1 

1 

2 

#30 

3 

1 

1 

2 

2 

#21 

4 

1 

1 

3 

1 

#50 

5 

1 

1 

3 

2 

#7, #8, #38 

6 

1 

2 

1 

2 

#9, #35 

7 

1 

2 

2 

2 

#25, #41 

8 

1 

2 

3 

2 

#11, #24, #27, #40 

9 

1 

3 

2 

1 

#48 

10 

1 

3 

2 

2 

#16, #23, #45 

11 

1 

3 

2 

3 

#32 

12 

1 

3 

3 

2 

#6, #12, #22, #46, #47 

13 

1 

3 

3 

3 

#3, #13 

14 

2 

2 

2 

2 

#1, #29 

15 

2 

2 

3 

2 

#26 

16 

2 

3 

2 

3 

#17 

17 

2 

3 

3 

3 

#19, #42 
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18 

3 

2 

2 

3 

#31 

19 

3 

2 

3 

2 

#2, #5 

20 

3 

2 

3 

3 

#15, #20 

21 

3 

3 

2 

3 

#10, #14, #34, #37, #44 

22 

3 

3 

3 

3 

#4, #18, #28, #33, #36, #43 


8. Discussion 

This study explores argumentative development in a secondary school. It examines the debatable social issues in 
argumentation learning that secondary students must master. An argumentative representation model has been 
established based on argumentative task analysis, which is further represented in a Bayesian network 
argumentative model to depict student progress. 

We describe students’ perspectives of argumentation in a series of argumentative concepts. These concepts are a 
mixture of argumentative knowledge and skills in both evidence and explanatory variables. Each variable is a 
cognitive component in the argumentative model, which represents students’ proficiencies in dealing with the 
debatable social issues. 

The Bayesian network consists of 15 variables in total. Eleven of these variables are evidence variables and four 
of them are explanatory variables. The explanatory variables dynamically represent students’ perspectives in 
argumentative learning based on the evidence received and by propagating the evidence vectors to 
eleven-evidence variable. The authors established an effective argumentative representation, which reflected the 
features of the students’ argumentative learning processes and results. 

The hierarchical argumentative representation model has effectively identified different types of students’ perspectives 
and beliefs in debatable social issues. The model provides moment-by-moment information differentiation for both 
students and argumentative representation in two dimensions. From a student-learning dimension, we can observe a 
student argumentation trajectory across these explanatory variables. From the argumentative representation we can 
examine which aspects of the argumentative learning need to be further improved. For example, in group 9, 
student #48 receives the score vector which was (1, 3, 2, 1). This means the student had lower scores in 
Perspectives and Argumentative Representation. The argumentative representation model is currently employed 
in debatable social issues and this model can be used in different social issues and domains. 

9. Limitations 

Fifty-two students are still not sufficient for Bayesian network to learn to become a robust network. The results 
are limitedly generalized to different argumentative learning settings and learning environments due to the small 
sample size. However, argumentative representation with Bayesian network model is very effective and can be 
used as an alternative assessment model in similar learning environments. The argumentative representation 
model can be used in individual learner assessment and for diagnostic purposes. 
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Appendix 1 

Fifty Two Students’ Scores from Eleven Evidence Variables* 


ID 

El 

E2 

E3 

E 4 

E5 

E6 

E7 

E8 

E9 

E10 

Ell 

1 

1 

0 

4 

3 

2 

1 

2 

2 

0 

0 

0 

2 

1 

1 

3 

3 

2 

1 

2 

2 

0 

1 

0 

3 

1 

0 

3 

2 

2 

2 

2 

3 

1 

0 

1 

4 

1 

1 

3 

3 

1 

2 

2 

2 

1 

1 

1 

5 

1 

0 

3 

2 

2 

1 

2 

2 

0 

1 

0 

6 

1 

0 

3 

2 

2 

2 

2 

2 

0 

0 

0 
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7 

1 

0 

3 

2 

2 

2 

2 

2 

0 

0 

0 

8 

1 

0 

4 

1 

1 

1 

2 

2 

1 

0 

0 

9 

1 

0 

4 

1 

1 

2 

2 

1 

0 

0 

0 

10 

2 

1 

2 

2 

2 

2 

2 

2 

0 

0 

0 

11 

1 

0 

3 

2 

2 

2 

2 

2 

0 

1 

0 

12 

1 

0 

3 

1 

2 

2 

2 

2 

0 

1 

0 

13 

1 

0 

3 

2 

2 

2 

2 

2 

0 

0 

1 

14 

1 

1 

4 

4 

1 

2 

2 

2 

0 

1 

0 

15 

1 

1 

3 

3 

1 

1 

2 

2 

0 

1 

1 

16 

1 

0 

3 

0 

2 

2 

2 

1 

0 

0 

0 

17 

2 

0 

4 

1 

2 

2 

2 

2 

0 

0 

0 

18 

1 

1 

4 

4 

2 

2 

2 

3 

0 

1 

0 

19 

1 

0 

4 

2 

1 

2 

2 

2 

1 

1 

1 

20 

1 

1 

3 

3 

1 

1 

2 

2 

0 

1 

1 

21 

1 

0 

3 

2 

0 

2 

2 

2 

0 

0 

0 

22 

1 

0 

3 

1 

2 

2 

2 

2 

1 

0 

0 

23 

1 

0 

3 

2 

2 

2 

2 

2 

0 

0 

0 

24 

1 

0 

3 

2 

1 

2 

2 

2 

1 

0 

0 

25 

1 

0 

3 

2 

2 

1 

2 

1 

0 

1 

0 

26 

1 

1 

2 

2 

0 

2 

2 

1 

0 

1 

0 

27 

1 

0 

2 

1 

1 

2 

2 

2 

1 

0 

0 

28 

1 

1 

2 

2 

2 

2 

2 

0 

1 

1 

1 

29 

1 

1 

2 

2 

0 

2 

2 

1 

0 

0 

0 

30 

2 

0 

2 

1 

0 

1 

1 

2 

0 

0 

0 

31 

2 

1 

3 

3 

0 

2 

2 

0 

0 

1 

0 

32 

2 

0 

3 

2 

1 

2 

2 

2 

0 

0 

0 

33 

2 

1 

4 

4 

2 

2 

2 

2 

0 

1 

0 

34 

2 

1 

3 

3 

1 

2 

2 

1 

0 

0 

0 

35 

2 

0 

3 

2 

2 

1 

1 

2 

0 

1 

0 

36 

2 

1 

2 

2 

2 

2 

2 

2 

0 

1 

1 

37 

2 

1 

3 

3 

1 

2 

2 

1 

0 

0 

1 

38 

1 

0 

3 

2 

0 

1 

2 

2 

1 

1 

0 

39 

0 

0 

2 

0 

2 

1 

2 

1 

0 

0 

0 

40 

1 

0 

3 

2 

1 

2 

2 

2 

1 

1 

0 

41 

1 

0 

2 

0 

2 

1 

2 

1 

1 

0 

0 

42 

1 

0 

4 

3 

2 

2 

2 

2 

0 

1 

0 

43 

1 

1 

3 

3 

2 

2 

2 

2 

0 

1 

0 

44 

2 

1 

3 

3 

2 

2 

2 

2 

0 

0 

0 

45 

1 

0 

3 

0 

2 

2 

2 

2 

0 

0 

0 

46 

1 

0 

3 

2 

2 

2 

2 

2 

0 

1 

0 

47 

1 

0 

3 

1 

2 

2 

2 

2 

0 

1 

0 

48 

0 

0 

4 

1 

2 

2 

2 

1 

0 

1 

0 

49 

1 

0 

3 

2 

2 

1 

0 

1 

0 

0 

0 
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50 002021110 0 0 

51 103 122220 1 0 

52 003221110 0 0 

*The variable from El to Ell are 11 evidence variables. The variable names can be referred to Table 2. 


Appendix 2 

Explanatory Variables of the Students’ Argumentation Categorical Coding 


ID 

Perspec¬ 

tives 

Perspectives 

category 

Stand 

Point 

Stand 

Point 

category 

Position 

and Claim 

Positon 

and claim 

Category 

Argumen¬ 

tative 

Represen¬ 

tation 

Argumen¬ 

tative 

Represen¬ 

tation 

Category 

1 

0.5244 

2.00 

0.5061 

2.00 

0.5345 

2.00 

0.5179 

2.00 

2 

0.6599 

3.00 

0.5510 

2.00 

0.8324 

3.00 

0.6501 

2.00 

3 

0.2518 

1.00 

0.8310 

3.00 

0.9491 

3.00 

0.8227 

3.00 

4 

0.7448 

3.00 

0.7325 

3.00 

0.9691 

3.00 

0.9145 

3.00 

5 

0.7964 

3.00 

0.5005 

2.00 

0.8017 

3.00 

0.5016 

2.00 

6 

0.2220 

1.00 

0.7580 

3.00 

0.8198 

3.00 

0.5891 

2.00 

7 

0.2227 

1.00 

0.3422 

1.00 

0.7956 

3.00 

0.4722 

2.00 

8 

0.2727 

1.00 

0.3422 

1.00 

0.7956 

3.00 

0.4722 

2.00 

9 

0.2533 

1.00 

0.5650 

2.00 

0.3221 

1.00 

0.3997 

2.00 

10 

0.7404 

3.00 

0.8231 

3.00 

0.6442 

2.00 

0.8419 

3.00 

11 

0.2036 

1.00 

0.5005 

2.00 

0.8017 

3.00 

0.5016 

2.00 

12 

0.1441 

1.00 

0.7520 

3.00 

0.8150 

3.00 

0.5661 

2.00 

13 

0.2660 

1.00 

0.8117 

3.00 

0.6992 

3.00 

0.7977 

3.00 

14 

0.9024 

3.00 

0.6810 

3.00 

0.8544 

3.00 

0.7562 

3.00 

15 

0.7270 

3.00 

0.4606 

2.00 

0.8757 

3.00 

0.8591 

3.00 

16 

0.0681 

1.00 

0.7209 

3.00 

0.5099 

2.00 

0.4453 

2.00 

17 

0.3523 

2.00 

0.8044 

3.00 

0.6197 

2.00 

0.7694 

3.00 

18 

0.7137 

3.00 

0.8020 

3.00 

0.9376 

3.00 

0.7599 

3.00 

19 

0.5076 

2.00 

0.7223 

3.00 

0.9669 

3.00 

0.8832 

3.00 

20 

0.7270 

3.00 

0.4606 

2.00 

0.8557 

3.00 

0.8591 

3.00 

21 

0.1778 

1.00 

0.3986 

1.00 

0.4875 

2.00 

0.3794 

2.00 

22 

0.1441 

1.00 

0.7520 

3.00 

0.8150 

3.00 

0.5661 

2.00 

23 

0.2009 

1.00 

0.7322 

3.00 

0.5246 

2.00 

0.4889 

2.00 

24 

0.2114 

1.00 

0.6103 

2.00 

0.8094 

3.00 

0.5389 

2.00 

25 

0.1926 

1.00 

0.4829 

2.00 

0.6424 

2.00 

0.4497 

2.00 

26 

0.6112 

2.00 

0.4622 

2.00 

0.6788 

3.00 

0.5699 

2.00 

27 

0.2070 

1.00 

0.6098 

2.00 

0.8091 

3.00 

0.5375 

2.00 

28 

0.7215 

3.00 

0.8397 

3.00 

0.8435 

3.00 

0.9061 

3.00 

29 

0.5733 

2.00 

0.4236 

2.00 

0.3389 

2.00 

0.4544 

2.00 

30 

0.1967 

1.00 

0.2155 

1.00 

0.2851 

1.00 

0.4879 

2.00 

31 

0.6941 

3.00 

0.5246 

2.00 

0.5316 

2.00 

0.7564 

3.00 


131 





www.ccsenet.org/ies 


International Education Studies 


Vol. 7, No. 11; 2014 


32 

0.2473 

1.00 

0.6656 

3.00 

0.5992 

2.00 

0.7091 

3.00 

33 

0.9274 

3.00 

0.8439 

3.00 

0.8888 

3.00 

0.9224 

3.00 

34 

0.7000 

3.00 

0.6870 

3.00 

0.4373 

2.00 

0.7748 

3.00 

35 

0.2229 

1.00 

0.5317 

2.00 

0.3139 

1.00 

0.5933 

2.00 

36 

0.7426 

3.00 

0.8562 

3.00 

0.8988 

3.00 

0.9705 

3.00 

37 

0.7511 

3.00 

0.7389 

3.00 

0.4862 

2.00 

0.9341 

3.00 

38 

0.1912 

1.00 

0.2055 

1.00 

0.9360 

3.00 

0.4430 

2.00 

39 

0.0624 

1.00 

0.3647 

1.00 

0.1050 

1.00 

0.1019 

1.00 

40 

0.2210 

1.00 

0.6251 

2.00 

0.9460 

3.00 

0.5845 

2.00 

41 

0.1027 

1.00 

0.4726 

2.00 

0.6333 

2.00 

0.4195 

2.00 

42 

0.5850 

2.00 

0.7856 

3.00 

0.8420 

3.00 

0.6964 

3.00 

43 

0.6842 

3.00 

0.7932 

3.00 

0.8481 

3.00 

0.7258 

3.00 

44 

0.7230 

3.00 

0.8243 

3.00 

0.6458 

2.00 

0.8466 

3.00 

45 

0.0681 

1.00 

0.7209 

3.00 

0.5099 

2.00 

0.4453 

2.00 

46 

0.2220 

1.00 

0.7580 

3.00 

0.8198 

3.00 

0.5891 

2.00 

47 

0.1441 

1.00 

0.7520 

3.00 

0.8150 

3.00 

0.5661 

2.00 

48 

0.2249 

1.00 

0.6819 

3.00 

0.5953 

2.00 

0.2937 

1.00 

49 

0.1496 

1.00 

0.4136 

1.00 

0.0165 

1.00 

0.2458 

1.00 

50 

0.0620 

1.00 

0.3638 

1.00 

0.0910 

1.00 

0.0930 

1.00 

51 

0.1441 

1.00 

0.7520 

3.00 

0.8150 

3.00 

0.5661 

2.00 

52 

0.1211 

1.00 

0.3677 

1.00 

0.9300 

3.00 

0.1108 

1.00 


Appendix 3 

Coding System of Debatable Social Issue 


i. 

Id 55 

Coding 


Definition 


0 

0 

St. 'MN 

wmm 

% Oo 

Mistakenly identify at least one non 
stake-holder who represent 

different perspectives 

Correctly Identifying the 

stake holder 

1 

1 

bp0t 

M 

Correctly identify all the stake 
holders that represent different 
perspectives listed, 

b-Mf 

0 



Perspectives are not clearly stated 

Multiple perspectives 

1 


a#.- 

Analyze issues from one single 
perspective 


2 



Analyze issues from two different 
perspectives 


3 



Analyze issues from three different 
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perspectives 


4. 



So on and so forth 


0 



Not able to identify any stake 
holder correctly 

Number of stake holders 

identified 

1 


XE^BJ Strife^ tH-# 

Correctly identify one stake holder 


2 


JE^BJ Strife^ iEM# 

8N0-#. 

Correctly identify two different 

stake holders 


3. 



So on and so forth 

2 




Definition 

a-'uMiWM 

0 


0£#5t:fcjg 

No statement of the position; the 
position statement is not clear 

State the stand point 

1 



The stating of position is not 
related to the question asked 


2 


ft 

o 

Able to state the position clearly 
responding to the question: e.g., 
able to state the position on either 
agreeing or disagreeinging on the 
position of 


1 


ftUT0it”W»o 

“agree” 

Agree/Disagree 

2 


fttlr*0I:”M3£J£. 

“disagree” 

3 






0 


Tttm, ^EBB. 

No position, thus there is no 
consistency between the position 

and claim 

a-Consistency of stand 
point and View/opinions 

1 



There is claim but it is not relevant 

to the position 


2 


jfeSW&EiE 

Position and claim are consistent 


0 



Did not apply information from 

case 


133 


























www.ccsenet.org/ies 


International Education Studies 


Vol. 7, No. 11; 2014 


Refer/integrate the case 

information 

1 


Wo 

Copy case information without any 
adaptation. For example, copy big 

chunk of case information in the 

answer without any modification 


2 


I- 4 

g*. 

mm 

0JSiPl4PffiMo 

Being able to re-state case 
information selectively; apply a 
paragraph single case information 
while justifying one’s perspective. 
Has adaptation and summary. 


3 


g4>, 

A 

MiMMJplifPWSo 

Selectively integrate multiple case 
information. Has adaptation and 

own summary 

!S$4^# > hA£niR 

0 


sm. 

Do not apply information outside 

of the case 

Use external information 

and/or personal knowledge 

1 


si 

f4o ±M, MSM 

mtiemi, 

$niPAP: A AM 

tAArtftTOf. 

Apply external information other 
than the case. E.g., textbooks, 
books, journal articles, or personal 
knowledge such as personal 
experience or some internalized 
knowledge 


0 


AffA##4Pi^ B A 

No explanation 

explanation 

1 


fFTMMWA 

Have explanation 











4-fcX 





Deflnition/Conceptual 

understanding 

0 



Did not list any main concept 


1 


AlAW 

List some of the main concepts, 

definitions, and content 


2 


^vS.f’jW 

List all the main concepts, 

definitions, and content 

5 -&zmm 





Conclusion 

1 



have conclusion 
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0 


m 

No conclusion 
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